Connecting o1 Pro to the World

Summary: The

MVP Construction:.

Create a Node.js script called tool_actions.js to provide a foundation for automatically operating the project by receiving instructions in JSON format (file edit, commit, test execution, etc.).

In-browser AI utilization concept:.

Browser automation with Playwright, etc., and aimed to log in to AI services, submit instructions, and obtain results, but Cloudflare's human judgment and element manipulation were difficult, so another approach was considered.

Conversion to Tampermonkey script:.

Tampermonkey is installed in Chrome, which is normally used, and a custom button (automation on/off) is added on the AI service page with a user script.

In an environment where page elements are loaded dynamically, detect when AI generation is complete (stop streaming or display a specific button) by making full use of waitForElement function, MutationObserver, etc.

Clipboard manipulation and visualization:.

After generation is complete, the button for copying is automatically clicked, and the clipboard contents are retrieved and displayed by navigator.clipboard.readText(), enabling the actual processing flow to be confirmed.

Through the above process, we are attempting to build and verify a flow of MVP for the work cycle of automatic command input, result acquisition, and processing reflection to the AI service on the browser.

---